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Abstract. In this paper we present product-form solutions from the 
point of view of stochastic process algebra. In previous work 16^ we have 
shown how to derive product-form solutions for a formalism called La- 
belled Markov Automata (LMA). LMA are very useful as their relation 
with the Continuous Time Markov Chains is very direct. The disadvan- 
tage of using LMA is that the proofs of properties are cumbersome. In 
fact, in LMA it is not possible to use the inductive structure of the lan- 
guage in a proof. In this paper we consider a simple stochastic process 
algebra that has the great advantage of simplifying the proofs. This sim- 
ple language has been inspired by PEPA [10] . however, detailed analysis 
of the semantics of cooperation will show the differences between the 
two formalisms. It will also be shown that the semantics of the coopera- 
tion in process algebra influences the correctness of the derivation of the 
product-form solutions. 



1 Introduction 

In this paper we present product-form solutions from the point of view of stochas- 
tic process algebra. The main motivation for this work is twofold: on one side, our 
formalisation clarifies the basic mechanisms that govern product-form solutions 
in Continuous Time Markov Chains (CTMCs), on the other side, we can gener- 
alise the notion of product-form solutions beyond queuing theory. Product-form 
solutions are efficient solutions for stationary distributions in CTMCs in general, 
while so far product-form solutions have been studied mostly in the area of per- 
formance evaluation/ queuing theory. The work presented here is an extension 
of previous work [16j where we have shown how to derive product-form solutions 
for a formalism called Labelled Markov Automata (LMA). In very simple terms, 
LMA describe the state space of CTMCs as labelled graph decorated with transi- 
tion rates. LMA are equipped with a basic mechanism to build complex CTMCs. 
LMA have proved very useful in helping to understand basic mechanisms that 
govern product-form solutions, and in providing a very elegant proof of the the- 
orem GRCAT [TB]. However, the disadvantage in using LMA is that the proofs, 
even for simple properties, are cumbersome. In LMA it is not possible to use the 
inductive structure of the language in a proof. 

In this paper we improve on previous work |16) by considering a simple 
stochastic process algebra (SSPA) , which preserves the semantics of cooperation 



of LMA. This simple language has been inspired by PEPA (TUI, however detailed 
analysis of the semantics of cooperation will show the differences between the 
two formalisms. 

In this paper we investigate the general principle that determines product- 
form solutions in CTMCs, and we show that the semantics of cooperation is 
crucial for the correct derivation of product-form solutions. We will introduce 
a simple language equipped with a rather unique, and possibly counterintuitive 
semantics, which guarantees the existence of product-form solutions. We will 
argue that the semantics presented here, is precisely what is needed to model 
rigorously product-form solutions for CTMCs. We shall also consider a biological 
example to show an interesting application of product-form solutions to a context 
different from queuing theory. 

2 Related work 

There is vast literature on the topic of product-form solutions and process al- 
gebra, and on the formalisation of the intrinsic mechanisms that determine 
product-form solution |19I12I8I2I9I7I2I3"| . On the relationship between process 
algebra and product-form solutions, Hillston, Thomas and Clark, played a ma- 
jor role [13I12I8I11I6I19) . The common denominator in these papers is the use 
of PEPA to model processes that are known to enjoy product-solution, and to 
extract, via PEPA, the modular properties of such processes. This body of work 
has demonstrated to the community the modelling power of PEPA. It was shown 
in [8 that quasi-reversible structures can be modelled in PEPA, together with 
a large variety of product-from solutions. We differ from the work carried out 
in PEPA, as our goal is not to define 'yet another stochastic process algebra' 
to model product-form solutions, but to design a language and a semantics to 
describe only the CTMCs that enjoy product-form solutions. With our formalism 
it is relatively easy to find new product-form solutions for CTMCs. This was not 
achieved in previous work. 

Another formalism that has been extensively used is the Generalised Stochas- 
tic Petri Nets (GSPN) [2171213] - to cite a few articles. The emphasis is to un- 
derstand which GSPN enjoy product-form solutions, and what conditions on 
GSPN are necessary to yield product- form solution [7] . We differ from the work 
on the GSPN as we use process algebra, and also because of the generality of 
our results. In this paper, and in previous work, the effort has been directed 
in defining a set of sufficient conditions that guarantee product-form solutions 
for time-homogenous CTMCs. Finally, it must be mentioned that similar efforts 
have been carried out by the community in performance |14I5I18) . 

The class of product-form solutions considered by [TB] is rather limited, while 
a true advancement was made by |14I5| with the notions of quasi-reversibility. 
Quasi- reversibility was introduced by Kelly [H] , and used only on the context of 
queuing networks. In [S], great efforts were successfully made to show generality 
and robustness of quasi-reversibility. Nearly all product-form solutions known in 
queueing networks are derived using quasi-reversibility. It was proved in [5] that 



quasi-reversibility is a sufficient condition for product-form solutions. The condi- 
tions of Theorem [T] can be seen as formaUsation of quasi-reversibility. The main 
difference between Theorem [T] and quasi-reversibility lies in the formalisation of 
the 'connection' of CTMCs. The way in which queues are connected together 
is expressed in natural language [5]. This is the main weakness of the work. 
Since it is not clear how to 'connect' CTMCs together, only networks of queues 
are considered. Understanding of how to connect queues together is clear in the 
community of performance evaluation. Our work goes further as it specifies, in a 
rigorous way, the 'connection' or, better, the cooperation among CTMCs. Note 
that we have only sufficient conditions for product-form solutions, not necessary 
conditions. As consequence, there are product-form solutions that we cannot 
characterise, for example We leave for future work formal development to 
deal with such product-form solutions. 

3 A simple language 

In this section we introduce a simple stochastic process algebra, SSPA. The 
main motivation to introduce such a formalism is to verify that the conditions 
for product-form solutions can be modelled in a language. SSPA is defined in 
a rather unusual way, but follows in the spirit ideas that were discussed in 
|13ll2j . We initially define simple processes. These are composed essentially by 
choice and by recursion. Similarly to PEPA, simple processes may or may not 
characterise a CTMC. Some simple process are incomplete, according to PEPA 
terminology, in the sense that some transitions lack the information about the 
rate. Such information can be inserted via a new operator: the closure. A second 
layer of processes is defined, as cooperation of simple processes. The operator 
for cooperation has been inspired by PEPA, but differently form PEPA is an 
n-nary -operator, like choice. Such operator, differently form PEPA-bow, cannot 
be expressed as multiple composition of the binary association. 

To formally define the language we assume the existence of a set of variables 
Var, and a set of actions Act on which the letter a,b,c . . . range over it. 

Definition 1 (Simple processes). The set of simple process, V, is is given 
by the following syntax: 

E::=0 I D 

where I is a finite set of indexes. 

For clarity in the notation we use the greek letters A, /i, . . . range over the 
set of positive real numbers IR^, the letters x,y,x, . . . range over Var and the 
letter r ranges over IR"*" U Var. When writing a variable in processes, we use a 
subscript that refers to the label. For example we would write (a, ya).E but not 
(a,?/6).E. A simple processes stand for the building blocks which are ultimately 
used to compose complex CTMCs. Nil, written 0, is the empty process; D is the 
symbol for the identifier. Identifiers are equipped with identifier equations such 



as D = M. The choice, '^i^j{ci,r).Ei, represents the standard selection of one 
of the possible transitions, and finally there is a new operator closure M 
This operator transforms all transitions labelled with the pair a and a variable 
into transitions labelled with the pair a and the real number A. The role of 
closure will become clear in the later development of the paper. The grammar of 
simple process aims to define the transition graph of a labelled CTMC, but not 
all transition graphs derived from this grammar are CTMCs due to the presence 
of variables. Examples of this kind can be seen in Fig. [T] 
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Fig. 1. Transition diagram of the process Mo 
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Fig. 2. Transition diagram of the process Mo[6<_a] 



Informally, we can say that the closure operator would transform a transition 

graph of the simple process Mq = (a, A).(6, a;b).(a, a:f,).Mo as in Fig. [T] as 
one in Figl2]for the simple process Mo[b^5]. 

If all transitions of a process are decorated with a real number, as in in Fig. 
[5J then the underlying model description is a time-homogenous CTMC, similar 
to PEPA. To formally define how to derive the CTMC of a given simple process, 
we need to give a formal semantics to SSPA via labelled transition system. 

Definition 2. A labelled transition system for simple processes written — ?>: V x 
[Act X IR^ U Var) x V is the smallest multi-relation that satisfies the rules in 
Table [3 

We write M — > M' if (M, (a,r), M') G— and — ?•* for the transitive closure 
of^. 

In what follows, we consider a relation that is generally defined in 7r-calculus 
|17] structural congruence. Structural congruence is a relation preserved by all 
operators of the calculus, i.e a congruence, that identifies terms that should not 
be distinguished for semantical reasons. Hillston [KT defined a similar relation 
in a operational way as isomorphism. 

Definition 3. Structural congruence, written = over the set of simple processes 
V is the smallest congruence that allows the reorder of terms in the choice. 



We use structural congruence as a relation to talk about individual terms in 
the summation, and to to avoid to be bothered by the order of terms in the 
summation. For example (a, A).Ei + {b,n).E2 = (6, /i).E2 + (a, A).Ei. We use S 
to indicate a set of terms of the summation that we do not wish to identfy i.e. 
(a, A). El + (&, /i).E2 + (c, 7).E3 = (a, A).Ei + S. 

Differently from CTMC, not all transitions in SSPA have a real number at- 
tached. These are called passive transitions. Passive transitions are transitions 
whose; delay has not yet been specified. The difference between passive and ac- 
tive transitions, is crucial in this work, so we proceed now to define such entities 
via analysis of the labels in a process. 

Definition 4. A label a G Act is called active with respect to a simple process 
M «/ M = (a, A).M' + S. A label a £ Act is called passive with respect to a simple 
process MifM = {a,Xa).M' + S. 

We now define a the set of labels that are active or passive in any possible 

evolution of the simple process. 

Definition 5. The set o/ active labels, written -4(M), is recursively defined as 
follows: 

(Nil) AiO) = 0; 

(Def) ^(D) = ^(M) ifD^ M; 

(Choice) ^(Eig/(«i,n)-Ej) = U,^i{ai : {ai,ri).Ei, n G IR+} U^(Ei); 
(Closure) ^(M[^^a]) = ^(M) U {a}. 

Definition 6. The set o/ passive labels, written P[M), is recursively defined as 
follows: 

(Nil) P(0) = 0; 

(Def) P(D) = r{M) «/ D i M; 

(Choice) P(X;,e/(a»,r,).E,) =U,67{ai : (a^.r^.^i, n G Var}ur{Ei); 
(Closure) V{M[,^^^) = P{M)\{a}. 

We simply write V and A for the set of passive and active labels when it is clear 
from the context which simple process we are referring to. 

Definition 7. A simple process M is closed if A(M) = 0, it is open otherwise. 

The closure operator transforms each open automata into a closed one. We 
now present a few properties of the closure operator, with respect to the seman- 
tics equivalence of strong bisimilarity. 

Definition 8. We define strong bisimilarity as the largest symmetrical relation 
= such that if Mi = M2, then if for all M[ it holds that Mi M'l then there 
exists M'2 such that M2 ^ M^, and M[ = M^. 

Proposition 1. 1. M[a^x] = M if M is closed. 

2. M[a<_A][6^^] = Mb<_^][a<-A]- 



3. Let 'P(M) = {ai, 02, . . . flAr} be the set of passive actions of 
Ai] . . . [flAT Atv] is closed. 

Proof. By induction on grammar of simple processes. 



Mrai ^ 



Sometimes, in the presence of multiple applications of the closure operator, 
we write M-p^R, where i? is a set of rates R — {ri, r2, . . . , rjv} and V = 
{01,02, . . . jOat} is the set of passive labels in M. Clearly, by generalisation of 
Proposition [1] this abbreviation is well defined, as it does not matter the order 
in which the closure is performed. Now we define the interaction among simple 



E' 



{a,Xa).E ^ E 



if D^E 



{a,fj.).E ^ E 



Table 1. Transition semantics of simple processes 



(g)^(Mi, .., M„ ..Mfc, ..M„) ^ 0^(Mi, .., M;, .., M;,, ..M„ 



{a £ L, k ^ i) 



Table 2. Transition semantics of interacting processes 



processes. 

Definition 9. The set of interacting processes, C, is defined by the following 
syntax: 

C::=M I (g)(Mi,...,MA,) 

L 

where L C Act, M was defined in Definition]^ and for all i, j < N if i ^ j it 
holds that A{Ui) n A{Mj) nL = V{M,) n V{Mj) n L = 0. 

Definition 10. The labelled transition system for the interacting processes writ- 
ten — jC X [Act X IR^ U Var) x C is the smallest multi-relation that satisfies the 
rules in Tahle\^ 



We write C C if (C, (a, r), C) G— arjrf — s>* /or i/ie transitive closure of 

->•. 

Crucial to this definition is that the interaction happens pairwise. For exam- 
ple, in queueing networks such as the Jackson network [5'., this captures the idea 
that customers hop from one node to one other. 

Comparison with PEPA The semantics of the interaction in SSPA has been 
inspired by PEPA [TU], but it is not identical. PEPA's interaction operation works 
on broadcasting while in SSPA the interaction/cooperation is strictly pairwise. 

In PEPA, cooperating processes over the same set of actions L is commuta- 
tive and associative with the respect to a notion of strong bisimulation. Strong 
bisimilarity (=) identifies processes that can carry out the same transitions with 
respect to the transition relation defined in Definition 1101 Therefore, we assume 
that Definition [5] is adapted to the interacting processes. 

In SSPA, the cooperating operator is commutative, but not associative with 
respect to strong bisimilarity, even under the same set of cooperating actions. 
Commutativity says that the order in which processes cooperate does not matter. 
If fact, two processes that differ only for the order of simple processes in the 
cooperation are strongly bisimilar, and, we will see, they have the same product- 
form solution. However, as far associativity goes, the reader can verify that 
(Ml (Bl M2) ®l M3 and Mi ®l (M2 ®l M3) have different transitions i.e they are 
not strongly bisimilar. To see this it suffices to take the following processes (Mi = 
(a, A).0 and M2 = M3 = {a,Xa).0 with L = {a} and verify that (M2©lM3) has no 
transition according to the semantics of SSPA. Therefore Mi (M2 ©l M3) = 
while (Ml ©I, M2) ©L M3 ^ 0, which implies, differently from PEPA semantics, 
that (Ml ©L M2) ©L M3 ^ Ml ©L (M2 (Bl M3). If we had used PEPA transition 
system we would have been able to prove that the two processes are strongly 
bisimilar. 

3.1 CTMC 

In this paper, we deal only with product-form solutions for time-homogenous 
CTMCs. For a time-homogenous CTMC, the generator matrix Q contains all the 
information to compute the transient and steady-state probability distribution. 
From the matrix Q it is possible to describe the state space of the CTMC and 
vice versa. Generally, in process algebra such as PEPA, the language is a means 
to describe in a modular way the state space of the underlying CTMC. The 
generator matrix is then appropriately recovered for computation purposes. If 
the interacting process C does not contain passive transitions, we can recover the 
CTMC by taking the set of all derivatives of C as the state space of the CTMC, 
and by generating the entries of the generator matrix Qc as the sum of all 
the real numbers of the transitions between two derivatives. Rates of self-loops 
should be ignored, and the diagonal of the generator matrix Qc is constructed 
as usual to ensure that the sum of the entries of the rows equals 0. Even in 



the presence of passive transitions in a process, the generator matrix can be 
recovered. However, the matrix may not be used for computation purposes, as it 
may contain the variables from the passive transitions. For this reason, in what 
follows, we describe how to build the generator matrix, and we will leave it to 
the reader, or to the context in which it is used, to establish if the generator can 
be used straightforwardly for computation purposes, or instantiation of variables 
is necessary. 

Given a process, we define the set of derivatives as the set of processes derived 
via the transitive closure of the labelled transition system. 

The set of derivatives of an interactive process C is defined as 5c — {C : 
C C'}. The transition rate from the state of the chain C to C is given by 
the sum of the rates of all the labelled transitions of the process i.e.: 

g(C ^ C) - J2 

C#C' 

If all transition rates q{C — > C) e IR^ then Qc is the generator matrix of 
the underlying CTMC of the interactive process. If for some rates it holds that 
g(C — >■ C) ^ IR"*" then we must specify that the variables in the prefix {a,x).E 
are considered the same if they occur with the same label. This observation has 
a huge impact in correct derivation of the generator matrix. For all intents and 
purposes, variables are considered the same if they are associated with the same 
label. For example we could write M = (a, x).{b, ^).M + (a, y).(c, z).M, however, 
in the construction of the generator matrix, either x oi y will appear in the 
definition of the rate. This concept has no meaning from the point of view of the 
process algebra, but it has huge impact in the building of the generator matrix, 
and in the computation of probabilities. The generator matrix of M, written Qm, 
will be 

(—2x X X 
^ -/i 
z -z 

while the matrix 

/-{x + y) X y 
Qm = M -/i 
\ z -i 

is not what we intended. We impose that x = y, since they appear with the 
label a and therefore we can treat a; as a variable, and apply standard numerical 
operations. The semantics for the variables is such that x^y ^ z as z occurs 
with the label c, not a. For this reason the subscript of the label of the action 
in variables is used in this paper. 

For convenience we write q{C — >■ C) = '^^.(-^(■, f for the transition rate 
with respect to a label a. We note that for the latter definition we also consider 
rates from a state to itself i.e. q{C —> C). This will be useful later in Theorem [TJ 
We observe that q{C C) = J^aeAct^i^ ~^ ^')- 



Given an interacting process C, we can generate the state space of the CTMC 
as Sc and the generator matrix Qc, then with an abuse of notation we refer to 
the properties of the process meaning the properties of the CTMC. Therefore, 
we can talk about a stationary or steady-state distribution of the process, ttc, 
meaning that its CTMC has a stationary or steady-state distribution vr. If Qc 
is the generator matrix of the underlying CTMC of C, then we write 7r(C) for 
invariant measure meaning the ttQc — 0. In other words, we use in the notation 
7r(C) instead of ttQc- For C G Sc we write 7rM(C') meaning the value of the 
vector ttm for the element C. If X^ceiSc ^ ^ then the CTMC is ergodic 

and TT is the state-state distribution of C j5j. 

4 Product-form solution 

We now present the main theorem of the paper regarding product-form solution 
for SSPA. The theorem asserts that for a given class of processes, that satisfies 
certain conditions on the rates and on the structure of state space, the product- 
form solution exists. We start with the definition of structure of the processes. 



Definition 11. In a simple process M — X]je/(^«i ^i)-Ei the label a is the unique 
passive label ij and only ifM = (a, Xa).E + 5 and M = (a, Xa).^' + S' then S' = S 
and E = E' . 

We now define a set of unique passive labels for a process. Such a set is not 
empty if in all possible evolution of the process, one passive transition with a 
given label is possible. 

Definition 12. The set o/ unique passive labels in a simple process M, written 
U{M), is recursively defined as follows: 



(Nil) U{0) = Act; 

(Def) U{D) ^U{M) i/D = M 



(Choice) W(X;ig/(ai,ri).Ei) = < 



if there exist a passive 

label inJ2ifziiai,ri).Ei 
which is not unique 

{Uiei{ai}) CiieiUiEi) if aiis a unique 
passive label in 



(Closure) U{M^a^^^) =U{U)\{a} 



Such a definition is necessary as we need to use process that have one passive 
transition. This restriction could be relaxed, but it would involve a more com- 
plicated statement of Theorem [T] 

We now provide the definition of well-formed simple processes, which are the 
building blocks for the correct definition of product form solutions. Well-formed 
processes are processes that will generate no confusion in the construction of 



product form solutions. Informally, we can think product-form as a way of de- 
composing the invariant measure of a CTMC. Now, if the CTMC has been built 
using simple processes and an empty cooperation set, then each simple process 
is independent of the other, and trivially the invariant measure can be written 
as the product of the invariant measures of each simple process. However, if a 
complex CTMC has been built using simple processes and a non-empty coopera- 
tion, then the behaviour of each simple process can be influenced by the others 
in the cooperation. If, however, in each simple process, the reversed rates of the 
cooperating transitions are constant in each state, then the invariant measure of 
a complex CTMC can be written as the product of the invariant measures of each 
simple process, in a similar fashion as if they were independent. To perform all 
these calculations correctly, we need to make sure that no confusion arises when 
writing the processes in SSPA, and therefore we need the notion of well-formed 
processes. 

Definition 13 (Well- formed processes). A simple process M is well- formed 
^f■■ 

1. A{M)r\V{U) = and 

2. iJV{U)^% thenV{U)=U{U). 

From a syntactic point of view, we have done the work for the following 
result for the product-form solution. The theorem considers only complex CTMCs 
composed by well-formed processes. A further condition is added on the outgoing 
rates of the simple processes to guarantee that on average, we can quantify the 
dependency among the various processes. 

Tiieorem 1. Given an interacting process C = ®^(Mi, M2, . . . , Mjv) composed 
by be well-formed simple processes Mi, M2, . . . , Mjv that cooperate on a finite set 
of actions L — {ai, 02, . . . um}- 

Assume that the state space of Sq = Smi x x • • • x Smn irreducible. If 
for all labels in the cooperation set L there exists a set of positive real numbers 
K = {ki, . . . , Km} such that, for any simple process Mi, the following equations 
are satisfied 

Em'pS <7(M' ^ M)7r,(M') 

^ — = Kr Me5M., a. eLn^(M,) (1) 

7ri(M) 

where iTi is the invariant measure of the closed process M^ = Mj[-pp^.j_jf] . Then 
the following statements hold: 

1. The invariant measure of the process ©^(Mi, M2, . . . , M^v) has the product- 
form: 

7r(0(Mi, M2, . . . , Ma,)) = 7ri(M5) ® ^2(M^) 7r2(M^) (2) 

L 

where ® is the Kronecker product^. 



^ If ix\,-K2 are two vectors, tti £ IR^^" and 712 £ irIx™ then he Kronecker product is 

TTi (g)7r2 = (pi7r2,P27r2, . . .Pn1T2) G IR^^^"". 



^- V^m^Sm ^^C^) ~ ^ (* ^ [1) • • • )-^]) tf^^''^ the steady-state probability 
distribution o/0j;^(Mi, M2, . . . , Mjv)- 

Proof. For (1) we first show that for all states (Mi, M2, . . . , Mjv) e Sm^ x <5m2 x 
• • ■ X iSm,y can derive 7r(Mi, M2, .... Mat) — YliLi ''^ii^i) for G ^m-?. Since 
we are considering the whole state space, the result 7r(0j;_(Mi, M2, . . . , Mat)) = 
7ri(Mf)(g)7r2(M|)(8). . .(8)7r2(M^) follows. We show now, for A/' = 2 that 7r(Mi, M2) = 
7ri(Mi)7r2(M2) when Mi(B{a.c}M2 - Generalisation to is straightforward. We ob- 
serve, that with an abuse of notation we write Mi to indicate the simple process 
in the cooperation, but also the process that forms the state space of Smi- The 
context distinguishes between these two mathematical objects. 

The global balance equations for the process Mi or M^; are the following, 
assuming that A{Mi) n L = {a} and A{M2) D L = {c} 

7rM5(Mi)( J2 qM5(Mi,a,M'i)+qM5(Mi,c,M'i)+ ^ qwj (Mi, 6, M'l)) = 

b^a,c 

qM5(M'i,a,Mi)7rMc(M'i)-|- ^ qwj (M'i,c, Mi)7rM5(M'i)-|- 

Y qM5(M'i,6,Mi)7rM5(M'i). (3) 

b^a,c 

We have underlined the transition rates what would have a variable in Mi but 
a real number in M^ By definition of well-formed simple process, we know that 
there is only one instance of qivij (Mi, c, M'^). 

For M2 or M2 the global balance equations would be similar by reverting the 
role of the rates of the actions a and c. 

We write now the global balance equations for the global state (Mi, M2) as 
follows: 

7r((Mi,M2))( Y q((Mi,M2),6,(M'i,M2))+ ^ q((Mi, M2), 6, (Mi, M^))+ 

M'jGSmi m;,gSm2 

Y q((Mi,M2),c,(M'i,My)+ q((Mi,M2),a,(M'i,M^))) 

(Mi,M^)eSMi XSm2 (M'l.M2)eSMi XSm2 

= Y q((M'i,M2),6,(Mi,M2))7r((M'i,M2)) + 
Y q((Mi, M^), 6, (Ml, M2))7r((Mi, M^)) + 

M2GSM2 

Y q((M'i, M^), a, (Ml, M2))7r((Ml, M'2)+ 

(Mi,M^)eSMiXSM2 



E q((M'i, M'2),c, (Ml, M2)V((m;, m^)). 

(M'i,M^)GSmi xSm2 

We assume that we can write the joint invariant measure in product-form, 
dividing by ttmi (Mi), ttmj (M2) and writing down the contribution of the rates of 
each simple process for the labels b ^ L we have: 



E q(Mi,6,M;)+ E q((Mi,M2),c,(M;,M^))- 



M^gSmi {Mi,M^)eSMi xSm2 

J2 q(M2,6,M^)+ E q((Mi,M2),a,(M;,M^)) 

M^eSM2 {M'^,M^)eSMi xSm2 

b^a^c 

b^a b^a,c 

„//|vy,/ |vy,/N ^^ 7^Ml(M^l)7^^/|3(M^) 
(m^m5 xS ^' ^^''^'^ " ^^^'^m.(Mi).m.(M2) + 



E q((M'i,M',),c,(Mi,M2)):""^^'''^)""^(''- 



<M' MMPS xS ^M,(MiVm.(M2)' 

We consider the rates in the terms with joint states. We observe that since we 
impose that the simple processes are well formed, this means that there is only 
one passive action in each process: in Mi the passive action will be labelled 
c while in M2 will be labelled a. The number of transitions in the joint state 
space x Smj will the same number as the active transitions. Therefore we 
can rewrite the global balance equation as follows: 



E q(Mi,6,M'i)+ E q(M2,&,M^)+ E q(M2,c,M^)+ 

M^GSmi M2GSM2 M^eSM2 

b^a,c b^a,c 

E q(Mi,a,M'i)= E ^(^1, 6, MO^MijMi) + 

E , x^nvbO*^ , ^ 7rMi(M'i)7rM2(M2) 
^(^-^'^^)^^;;:(M^+^E ^(^-«'^^).M.(Mi).M.(M2) 

M2€Sm2 M^GSm2 M'^GSmi 

b^a,c 

^ \^ \- „(.A' M ^ ^Ml(M;)7^M,(M^) 

We can now rewrite the global balance equations in Equation |3] in the following 
convenient way: 




b^a.c 




7rM;(M^i) 



+ E qM5(M;,6,Mi) 



7rM^(M^i) 
7rMj(Mi) 



) 




By subtracting each term side of the last two equation we obtain: 



Y q(M2,&,M^)+ Y q(M2,c,M^) 



M2eSM2 



E q(M2,^M2) 



7rM2(M2) 



•a 



'a 



The latter equation can be rewritten to see that the global balance equation of 
M2 by expanding the Definition of Condition [T] of Theorem [1] 

The proof is very elegant, not because it uses global balance equations, but 
because it solidly relies on the semantics of the cooperation. Such semantics 
establishes the contribution of each component to transform the global balance 
equations of the joint processes into the global balance equations of each simple 
process. Further considerations on the cooperation operator will lead to conclude 
that the semantics given in this work is the right one, as it allows the correct 
substitution of the rates in condition [1] of Theorem [1] in the passive transitions. 
As Hillston pointed out in |10) . passive transitions lack of information about 
the speed of the transition. Such information is given by the cooperation with 
the active partner. In this work we embrace this view fully, but we also find 
out the right rates (the ones given by condition [1] of Theorem [T|) for the passive 
transitions to proceed in isolation. We could have chosen an arbitrary rate to be 
substituted into the passive transition. This would have made no sense at all. 
The product form solution relates the rates of the joint process with the rates 
of the single components. We can see why it is important that cooperation is 
not associative, and the broadcasting semantics of PEPA would not work here. 
Consider three well- formed simple processes Mi, M2, M3 specified as follows Mi = 
(a, A).Mi, M2 = (a,a;a).M'2, M3 = {a,Xa).M'^ such that condition [T] of Theorem[T] 
is satisfied for Mi. Assume that we have PEPA semantics and M2 © {ajMa 
M'2 © {a}M(, and Mi © {a}(M2 © {ajMg) ^ Mi © {a}(M'2 © {ajM'^). Now, to 
identify the product-form solution we would need to substitute in both processes 
the rate Kq M2[a^K„]7 ^sla^Ka.]- The product from would not work at all. The 
reader can verify this by inspecting the proof of theorem [T] Now consider the 
equivalent process (Mi © {a}M2) © aMs ^ (Mi © {a}M^) © {a}M^ such that 



(Ml © {a}M2) ^ {M'l ® {a}M^). We would obtain a series of substitutions 
M2[a<_Ka] a-nd, if (Mi © {a}M2) satisfy the conditions in theorem [T] for a, then we 

would have Mafa^^*], where = E(Mt,M*) -^ ^(m^'ImI) Clearly this would lead 
to different product-form solution from Mi © {a}(M2 © {ajMs). In conclusion, 
differently from PEPA semantics, we do not wish to have associativity as the 
rates used for the closure of each simple process matters. Such rates depend on 
how we group simple processes together. The semantics of the cooperation is 
the exactly was is needed to correctly interpret product-form solutions. In this 
work we are not concerned about numerical or analytical methods for solution 
equations in the form of[T] Such methods can be found in [5]. 

5 Product-form solutions for biological systems 

As stated in the introduction, product-form solutions have been mostly used in 
queueing theory. There has been a recent interest in product-form solution for 
biological system |15ll| . In particular in |15ll) consider only chemical reactions, 
while we show here a variation of the product-form solutions for more complex 
systems. 

Assume we have a cancerous cell, that grows, in a limited way provided that 
there is enough energy. In absence of energy the cell could die, with a certain 
probability p. We model the cell as follows: 

Co = {a,Xa).Ci 

Ci = (a, Xa)-C2 + (c, 7i).Co -I- (c, Kc).Ci 

Cjv = (a, Xa).CN + (c, 7jv)-Co -I- (c, Kc).Cn- 

The transitions labelled a stand for the energy that will allow the cell to grow. 
As energy is provided by the environment, we model it as a passive transition. 
We note that the cell has a finite growth: even in the presence of an infinite 
amount of energy, the cell will stop growing. The transitions labelled c stands 
for cancerous events: they could inhibit growth and kill the cell. 

We model the energy as a switch, either there is energy for the cell to grow, 
or there is no energy: 

Eo = (a. A). El + (a, (5).Eo 
El = (d,5).Eo. 

The rate S represents the speed at which the environment supplies energy. Sim- 
ilarly, we model the trigger for cancer which reduces the size of the cell as a 
switch: 

To = (c, a;c).Ti + (c, Xc).To 
Ti = {e,v).To. 

f The system is the following: ©{a_c}(Eo, Co, To), and the steady state prob- 
abilities are 7r(©a,c(Eo, Co, To)) = 7ri(Eo) 7r2(Co[o<-5]) ^ t^sO'oIc^k,]) where 



= T3^i(C3)+7^MC2)+7i^i(Ci) ^ observe that Eq, Co,To are well formed pro- 
cess and that the conditions of Theorem [1] are satisfied. 

The transition graphs of the state-space processes can be found in Figure [Sj 




CXc 



Fig. 3. Transition graphs of the state-space of the processes Eq, Co, To 



6 Conclusion 

The main interest for product-form solutions arises when a CTMC contains a 
rather large state space, and the analytical computation of the steady state 
probability /invariant measure can be computationally prohibitive. In this paper, 
we have analysed the cooperation operator for a simple process algebra and its 
relationship with product-form solution. We have clarified the semantics of such 
operator, and we have shown that such semantics is necessary to derive correctly 
product-form solutions. 
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